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1. Introduction 

Clouds act to reduce the signal level and may produce noise dependence on the 
complexity of the cloud properties and the manner in w'nich they are treated in the profile 
retrieval process. There are essentiaUy three ways to extract profile information from 
cloud contaminated radiances: (1) cloud-clearing using spatially adjacent cloud 
contaminated radiance measurements, (2) retrieval based upon the assumption of opaque 
cloud conditions, and (3) retrieval or radiance assimilation using a physically correct 
cloud radiative transfer model which accounts for the absorption and scattering of the 
radiance observed. Cloud clearing extracts the radiance arising from the clear air portion 
of partly clouded fields of view permitting soundings to the surface or the assimilation of 
radiances as in the clear field of view case. However, the accuracy of the clear air 
radiance signal depends upon the cloud height and optical property uniformity across the 
two fields of view used in the cloud clearing process. The assumption of opaque clouds 
within the field of view permits relatively accurate profiles to be retrieved down to near 
cloud top levels, the accuracy near the cloud top level being dependent upon the actual 
microphysical properties of Ae cloud. The use of a physically correct cloud radiative 
transfer model enables accurate retrievals down to cloud top levels and below semi- 
transparent cloud layers (e.g., cirrus). It should also be possible to assimilate cloudy 
radiances directly into the model given a physically correct cloud radiative transfo* model 
using geometric and microphysical cloud parameters retrieved from the radiance spectra 
as initial cloud variables in the radiance assimilation process. This presentation reviews 
the above three ways to extract profile information from cloud-contaminated radiances. 
NPOESS Airborne Sounder Testbed-Interferometer (Smith et. al., 1999) radiance spectra 
and Aqua satellite AIRS (Aumann et. al., 2003) radiance spectra are used to illustrate 
how cloudy radiances can be used in the profile retrieval process. 

2. Ooud Handling Techniques 


The vertical resolution of soundings obtained from high spectral resolution infrared 
spectrometers is highly dependent on the radiance signal to noise ratio. Clouds act to 
reduce the signal level and may produce noise dependent on the complexity of the cloud 
properties and the manner in which they are treated in the profile retrieval process. There 
are essentially four ways used to deal with clouds: (a) hole hunting, (b) cloud-clearing 
using spatially adjacent radiance measurements, (c) opaque cloud training, and (d) 
realistic cloud training. 


(a) Hole hunting: The success of hole hunting is highly dependent upon the instrument 
field of view size. Figure 1 below shows that for the field of view size of the current and 
planned polar orbiting sounding instruments (i.e., AIRS, IASI, and CrIS), the percentage 
of 50 km X 50 km sounding regions with clear fields of view will be too small (i.e., < 30 
%) to provide adequate global sounding coverage. Thus, we must be able to treat clouds 
in either the sounding retrieval or the radiance assimilation process in order to get the full 
value of these data in global numerical weather prediction. 
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F^ure 1: Probability of sampling clear air as a fimction of field of view size 


(b) Cloud clearing: Cloud clearing produces the radiance observed in the clear air 
portion of a partly cloudy area, and therefore soundings to the surface, when the cloud 
height and optical properties are horizontally uniform (Smith, 1968). Figure 2 below 
shows a cloud-clearing algorithm formulated for utilizing high spatial resolution imager 
observations (i.e., MODIS) for processing the low spectral resolution Aqua AIRS spectral 
radiance data. As can be seen, under the assumption of horizontally uniform surface and 
atmospheric condition, including cloud height and cloud microphysical prop^es, the 
radiance for the clear portion of a set of partly cloudy fields of view can be extracted 
from the cloud contaminated radiances given a single parameter, N*. Since N* is 
independent of spectral frequency, it can be defined fiom the observed radiances for a 
single spectral charmel whose ra^ance is heavily influenced by the cloud, provided that 
the clear radiance for that channel is known. N* can thus be defined by using the clear 
air radiances observed within the two adjacent sounding instrument fields of view as 
observed with a high spatial resolution imager together with the cloud contaminated 
radiances observed widi the sounding instrument. In this case the radiances for an 
atmospheric window spectral region (i.e., 10.5 - 1 1.5 micron) are used for both 
instruments. The high spectral resolution radiances Ifom the sounding instrument are 
spectrally convoluted using the instmment response function of the lower spectral, but 
higher spatial, resolution imaging radiometer for the determination of N*. Once N* is 
defined, the clear air spectmm for the sounding instmment can be calculated as shown in 



figure 2. Other imager instrument clear air spectral channel radiances can then be 
approximated by spectral convolutions of the derived sounder clear air spectrum. A 
comparison of the sounder simulated clear air radiances for the imaging inslmment 
spectral channels with those actually observed by the imager enables erroneous estimates 
arising from non-uniform surface and atmospheric conditions to be filtered from the set 
to be used for atmospheric sounding determination or for direct assimilation into the 
NWP model analysis/prediction process. 



CleaB* 

Imager 


Qondy 

Sonnder 

IFOVi 




R^(v)-N (v)i^(v) 


l-.V M 

where N*(v)=£(v)jN,/e 2 (v)N 2 . 


R,(W)-K,^(AW) 


Rclr(Av) = J 0(v)RcIr(v)dv 

Filter 

|A/r(Av)-i^/r(Av)|>5 


R|(W) and R^fW) are sounder window radiance measurements in FOVs 1 and 2. 

R^(AW) is the clear window radiance measured b>' the imager. R^(Av) is die clear 
radiance measured in the absorption chamiel(s) of the imager. 5 is the expected error, 
due to measurement noise, between the true and reconstructed imager clear radiances. 

Figure 2: Basic cloud clearing methodology. The relationships are valid under the 
assumption of horizontally uniform cloud height and microphysical properties. 


For the case of the Aqua satellite, the MODIS imaging spectrometer possesses 
numerous 1 km spatial resolution spectral absorption channels, which overlap the 
spectral coverage of the AIRS (see figure 3 below). 
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An example of the extraction of the clear air radiance from a set of cloud-contaminated 
fields of view is shown in figure 4. Ifere the derived clear air spectrum is compared with 
a nearby observed clear sky spectnim. The derivation is for radiances observed over 
water and for low-level scattered cumulus cloud conditions. As can be seen, the clear air 
spectrum is successfully determined for this case. 
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Figure 4: Exan^le clear air radiance spectrum derived from the combination of Aqua AIRS and 
MODIS data 

Table 1 below shows the clear air sounding radiance yields without and with the use of 
MODIS absorption channel data for filtering erroneous cloud cleared radiance spectra. 
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Here, the radiance spectra, for different spatial resolutions, and MODIS observations 
were simulated from NPOESS Airborne Sounder Testbed Interferometer (NAST-I) data, 
which have a 3 km spatial resolution (Smith et. al., 2003). Only cases where at least one 
clear NAST-I field of view within the 40 km x 40 km sounding area were included in the 
analysis since for these cases the correct clear radiance spectrum was known for 
validation purposes. The spatial resolution most representative of the AIRS is the 18 km 
linear resolution case. As shown, the yields of the MODES absorption channel filtered 
data are only slightly lower than the unfiltered data indicating that the high N* filter (Le., 
N* > 0.75) was able to detect many of the erroneous cloud cleared radiance estimates. 


Table 1; 40 km x 40 km Sounding Area Gear Field of View RMi^ce YieWs (%) ^ 
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However, as shown in figure 5 below, there is a significant difference in the £K:curacy 
between the error estimates for these two cases. Without the use of the MODIS filter, the 
errors of the clear sky estimates are too large to be useful for retrieval or radiance 
assimilation. With the use of MODIS, more acceptable results are achieved but these 
errors are still larger than those desired for the extraction of profile information with hi^ 
vertical resolution. 
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Figure 5: Cloud clearing with and without unager absorption channels (Le., MODIS). 

(c) Opaque cloud assumption: Assuming that opaque clouds exist within the 
instruments field of view produces, accurate profiles can be retrieved down to levels 






























close to the cloud top level. This is because there is an ambiguity between an opaque 
cloud condition and a clear atmospheric profile, which is isothermal below the cloud 
level. The vertical resolution of the hyperspectral radiance measurements is high enough 
to resolve the equivalent isothermal condition within 1-2 km of the cloud level. Thus 
merely treating an opaque cloud radiance spectrum as if it were from a clear sky 
atmospheric condition should tend to result in the retrieval of the correct atmospheric 
profile above the cloud top level, with a fictitious isothermal, and saturated, profile 
condition being retrieved below the cloud top level. The retrieved relative humidity and 
the abrupt change in vertical temperature lapse rate enable one to determine the cloud 
level. 


Hgure 6 below shows an example of results assuming clear atmospheric conditions for 
cloud-contaminated radiances as obsei ved with the NAST-I instrument. Here the 


retrieval method is the Eigenvector (EOF) regression method (Smith and Woolf, 1976, 
and 23iou et. al., 2002) where training data set, used for the radiative transfer calculations, 
included cloudy radiosondes in which the temperature profile was adjusted to be 
isothermal, and the relative humidity was set to 100 %, below the cloud level (Smith et 
al., 2004). Thus, the regression relations were trained to retrieve the clear sky equivalent 
profiles below the cloud under cloudy sky conditions. As can be seen, under the clear 
sky assumption, the temperature tends toward the isothermal condition and the relative 
humidity tends toward saturation to a degree dependent upon the opacity of the cloud. 
Even in the clear air columns between the cloud elements, where the temperature profile 
does not tend towards the isothermal condition, the layer of high moisture responsible for 
the existence of the nearby clouds can be seen in the relative humidity vertical structure. 
The advantage of this single approach for handling clouds is that it allows profile 
information down to cloud level to be assimilated into the model. However, it is not clear 
how to incorporate this information for the case where one is assimilating radiances 
rather than retrievals. One method might be to replace the erroneous profile retrieved 
below the cloud top level with the model profile and recompute the radiances using the 
hybrid profiles. The radiances whose weighting functions peak at and above the cloud 
level, which are heavily influenced by the retrieved profiles above cloud level, can then 
be assimilated as clear air radiances. 
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Figure 6: NAST-1 retrieved temperature and moisture structure for a broken cloud 
condition with cloud tops near the 6 km level. 


(d) Realistic Cloud Radiative Transfer Model: However, if the clouds are high and there 
is significant spectral structure in the absorption of the clouds (i.e., a common 
characteristic of Cirrus clouds), errors in the profiles above the clouds may occur. Thus 
for high cloud cases, a more realistic cloud model is required to get accurate profiles 
down to the cloud top level. Also, if the cloud is semi-transparent or broken, the profile 
below the cloud level should be retrievable using a physically based cloud radiative 
transfer model. The physically based cloud radiative transfer model was developed by 
the University of Wisconsin - CIMSS (Huang et. al., 2004) using DISORT calculations 
performed for a wide variety of cloud microphysical properties by Ping Yang, at the 
Texas A&M University (Yang et. al., 2003). For the retrieval using the EOF regression 
method, the clouds can now be included in a more realistic manner with a statistical 
distribution in accordance with real observations conducted over many years from 
aircraft and balloon (Heymsfeld et al., 2(X)3). Table 2 below summarizes the 
characteristics of the realistic cloud model and the simulations of clouds as used for the 
EOF regression training. For semitransparent and/or scattered cloud with an effective 
optical depth (defined here as the exponential of a negative argument which is the 
product of the fractional cloud amount times the cloud visible optical depth), which is 
less than unity, the correct profile below the cloud is attempted to be retrieved. If a lower 
level cloud underlies the semitransparent and/or scattered upper level cloud, the lower 
level cloud is treated as an equivalent clear isothermal condition as described above for 
the opaque cloud condition retrieval. EOF regression enables both the cloud height and 
the cloud microphysical properties of the highest-level cloud to be estimated. 




Table 2; Cloud Radiative Transfer Model and Qoud Simulation Characteristics 

• Ferfarm a realistic simiilatioii of doads for synthetic EOF radiance training 

• Diagnose 0-2 cloud layer's from radiosonde relative fanmidity profile 

- A single cloud hytr (either ice or liquid) is inserted into the input radiosonde profile. 

- Approximate lower level cloud using opaque cloud representation (i.e., isottormal/saturated) 

• Use parameterizatien of Heymsfeld’s^ baHoon and aircraft dond 

iBicroplQ^al data base (2083) to specify dood effective partide 

radios, and dond optical depth, T, (i.e., a [t - bt^D . 

- Di£Eerent habitats can be specified OSexagonal columns assumed here) 

- Different clouds microphysical properties are simulated for same radiosonde using random 

number generator to specify visible cloud c^tical depth within a pre>specified range. 10 % 
random error added to parameterized effective radius to account for real data scatter. 

• Use X^oI i R TSa/PISORT ^miKrahiip tsbls” tc spodfy dondi rsdiativo properties 

- J^ctral transmittance and reflectance for ice and liquid clouds interpolated from multi- 

dimensional look-up table based on BISOKT multiple scattering calculations for the 
(wavenumber range 500 - 2500 emr^ zenith angle 0-80 deg, Deff (Ice: 10 - 157 um. 
Liquid: 2 - 100 um). OD(vis) (Ice: 0.04 - 100, Liquid 0.06 - 150) 

• Compote EOFs and Regressions from clonfy radiance data base 

- ^Regress cloud properties (p, X, and sur&ce and profile parameters against radiance EOFs 

- For small optical depth, output entire profile down to sur&ce or lower opaque cloud level 

- For large upp er level cloud optical depth, ou^ut profile a^ovc the i 5 >pcr cloud level 

Heymstield, A. J., S. Malrosov, amf B. A Baum: tee water path>op1ical depth relationships for cirrus and precipitair^g cloud 
layers. J. Meteor. October 2803 


Figure 7 shows a vCTtical cross section of temp^ature and moisture profiles retrieved from NASAER-2 
aircraft NAST-I data for a very cloiKly situation. The retrieved cloud height is conqpared with that estimated 
firom a nadir looking Cloud Hiysics LJDAR (CPL) on-board die ER-2 aircraft The flight track is shown 
over visible and IR images from the GOES spacecraft A comparison of a NAST-I profile at 19 GMT with 
the 00 GMT MHX radiosonde is also shown alongside cross-section near the radiosoiKle station. The 
retrievals were produced using die EOF regression method where a very large sanqile of radiosondes from 
a year pmod was used to simulate NAST radiances. Clouds 'were introduced at levels ^ere the 
radiosonde humidity exceeded a threshold prescribed as a function of altitude. Cloud microphysical 
properties were assigned using a random number generator to define an optical depth between 0 and 4, 
from a uniform distribution of the logarithm of the optical depth, and the effective particle radius was 
defined using the relation provided in table 2 above which is based on many years of cloud miarqphysical 
propoty obso^ations from balloon and aircraft. The particle radius is changed by a random amount 
selected from a guassian distribution of random numbers with a standard deviation of 10% in ordo- to 
represent the scatter of real obsarvations. If two or more cloud layers exist, the lower level clouds are 
represented as a tte equivalent cloudfree isothermal temparature condition in the radiative transfor 
calculation. Thus the atten^t is to retrieve profiles below cptically thin uppa* level cloud only (e.g., diin 
Cirrus). Regression relations are also genaated fa predicting cloud height, visible optical dqith, and 
particle diameta. Because the radiance is hi^ly non-linear with respect to cloud height, statistics are 
formulated fa one class of data ^ch contains all cloud height conditions and eight otha height classes 
for ^ch the cloud height has been stratified to within 1 km of the mean for that class. The final cloud 
height class to be used for the retrievals is obtained by iteration beginning with the unclassified class to 
predict the initial cloud height stratification for the retrievals. Usually, the final cloud height class is 
defined within five iterations of the cIoikI teight prediction process. 


In the retrievals shown in figure 7, the jH-ofilcs retrieved below clouds with a predicted optical depth greater 
than 1 were considered missing since their accuracy would be degraded from that achievable und^ 
cloudless sky conditions. 
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Figure 7: Temperature and humidity cross-sectioiis from NAST-1 cloud contaminated radiances 
observed along the flight track of the NASA ER-2 aircraft flying at 20km flight altitude over a wide 

variety of clouds. 


As can be seen there is excellent agreement between the LIDAR and NAST-I retrieved cloud heights 
indicating that the retrieval of other properties, such as the cloud microphysical properties and the 
temperature and humidity profiles should also be accurate. The horizontal uniformity of the retrieved 
temperature and humidity conditions across the wide variety of cloud height conditions indicate that this is 
the case. 

Evidence of the accuracy of the profile conditions which can be retrieved under cloud conditions is given 
by figure 8 which shows a comparison of the EOF regression retrievals for this case obtained from AIRS 
and NAST-I data in comparison to dropsonde observations made along the flight track of the ER-2. One 
can see excellent correspondence between all three observations even though their time differences may be 
as large as 4 hours. 
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Figure 8; Retrievals of atmospheric temperature at SOOmb and 700 MB obtained from Aqua satellite 
AIRS radiance spectra and NAST-I radiance spectra. Dropsondes from the NOAA Gulfstream 
along the track of the ER-2 aircraft are shown to validate the retrieval results. 


For the radiance assimilation process, one might use the retrieved cloud height, optical depth, and particle 
diameter properties with the cloud radiative transfer model used here in the assimilation process. Spectral 
radiances for channels which peak below clouds with an optical depth greater than unity could be deleted 
from the assimilation process in order to minimize the effects of errors in the cloud representation. 


3. Summary and Conclusions 

Cloud greatly complicates the interpretation of infrared sounding data. The new hyperspectral resolution 
infrared sounding systems alleviate much of the ambiguity between cloud and atmospheric temperature and 
moisture contributions. However, in heavily clouded situations, the thermodynamic profile information to 
be retrieved is limited to the atmosphere above clouds. The results of the study presented here indicate 
some success in the ability to retrieve information below scattered and partially transparent Cirrus cloud 
(i.e., clouds with effective optical depths of less than unity). The thermodynamic profile information can 
be obtained by a combination of cloud clearing and by direct retrieval from the clouded radiances using a 
realistic cloud radiative transfer model. Results achieved with airborne NAST-I and Aqua satellite NAST-I 
observations show that accuracies close to those achieved in totally cloud-free conditions can be achieved 
down to cloud top levels. The accuracy of the profile retrieved below cloud top level is dependent upon the 
optical depth and fractional coverage of the cloud. 

For the assimilation of cloudy radiances into an NWF model, two approaches might be considered: (1) an 
indirect method whereby clear sky equivalent radiances are assimilated, and (2) a direct method in which 
the actual cloud radiances are assimilated. For the indirect method, a combined EOF regression retrieval 
followed by a 1-d variational retrieval, using the cloud parameters from the EOF regression retrieval, is 
performed and the results above the highest cloud level with an effective optical depth greater than one is 
amalgamated with the model profile to recompute the equivalent clear sky radiances for the hybrid 


atmospheric profile conditicn. One can then assimilate the “dear” radiance whose weighting functions 
peak above the dmived cloud level. 

In the direct cloudy radiance assimilation method, a cloudy sky condition radiative transfer model is used in 
the assimilation process. In this technique the intiai cloud parameters for the radiative transfer calculation 
are taken fiom the EOF regression retrieval. The cloud parameters are allowed to adjust as part of the 
cloudy radiance assimilation process. 

The inq>lementation of either of the two approaches suggested above requires a considerable research 
development effort. Howevm', cloudy sky radiative transfer models now exist which should enable the 
extraction of {Hofile information from cloud contaminated radiances suitable for the numerical weather 
prediction application.. 
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